Submission for Gesture Workshop 2001 Hand Postures for Sonification Control -extended Abstract
نویسندگان
چکیده
Sonification is a rather new technique in human-computer interaction, making usage of our auditory perception channel. Different from speech interfaces, sonification uses non-verbal sounds as the result of its computation. One approach in sonification research is the introduction of sonification models, which aim to construct “virtual data materials” from high-dimensional data to be explored by the interaction with humans. We propose the use of hand postures as a particularly natural and efficient means of interaction both for this exploration task and for other parameter control tasks within exploration of high-dimensional data. The presented implementation applies neural networks for the identification of continous hand postures and uses a realtime sound synthesis engine. In this paper, we present our system and first applications to the control of sounds. Sound examples are also given.
منابع مشابه
Sonification of Gestures Using Specknets
This paper introduces a novel approach to gesture recognition for interactive virtual instruments. The method is based on the tracking of body postures and movement which is achieved by a wireless network of Orient-2 specks strapped to parts of the body. This approach is in contrast to camera-based methods which require a degree of infrastructure support. This paper describes the rationale unde...
متن کامل3D Gesture Recognition Based Wireless control System
Gesture-based interfaces, in which the user specifies commands by simple freehand drawings, offer an alternative to traditional keyboard, menu, and direct manipulation interfaces. The ability to specify objects, an operation, and additional parameters with a single intuitive gesture makes gesture-based systems appealing to both novice and experienced users. Unfortunately, the difficulty in buil...
متن کاملComparison of Feedforward (TDRBF) and Generative (TDRGBN) Network for Gesture Based Control
In Visually Mediated Interaction (VMI) there is a range of tasks that need to be supported (face and gesture recognition, camera controlled by gestures, visual interaction etc). These tasks vary in complexity: some can be predefined for supervised learning, some need self-organisation, some need generative models to be learned. Generative models may offer strong advantages in cases where a high...
متن کاملSonically Augmented Artifacts: Design Methodology Through Participatory Workshops
Participatory workshops have been organized within the framework of the ANR project Legos that concerns gesture-sound interactive systems. These workshops addressed both theoretical issues and experimentation with prototypes. The first goal was to stimulate new ideas related to the control of everyday objects using sound feedback, and then, to create and experiment with new sonic augmented obje...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2001